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Abstract. In this paper, we approach the problem of finding the zeros of the sum of a 
maximally monotone operator and a monotone and Lipschitz continuous one in a real 
Hilbert space via an implicit forward-backward-forward dynamical system with noncon¬ 
stant relaxation parameters and stepsizes of the resolvents. Besides proving existence and 
uniqueness of strong global solutions for the differential equation under consideration, 
we show weak convergence of the generated trajectories and, under strong monotonicity 
assumptions, strong convergence with exponential rate. In the particular setting of min¬ 
imizing the sum of a proper, convex and lower semicontinuous function with a smooth 
convex one, we provide a rate for the convergence of the objective function along the 
ergodic trajectory to its minimum value. 
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1 Introduction 

In this paper, we address the monotone inclusion problem 

find X € "H such that 0 S Ax + Bx, (1) 

where "H is a real Hilbert space, A : "H ^ "H is a maximally monotone operator and 
H —>■ M is a monotone and ^-Lipschitz continuous operator for /3 > 0, by means of 
the dynamical system of equations 

f z{t) = -l{t)Bx{t)) 

< Q = x{t) + x{t) — z{t) — ^{t)Bx{t) + ^{t)Bz{t) (2) 

[ x(0) = xo, 
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where 7 : [0, + 00 ) —5- (0, j3) is a Lebesgue measurable function, xq € "H and J^(^t)A denotes 
the resolvent of the operator 'y{t)A for every t E [0, + 00 ). 

The pioneering work m of Crandall and Pazy represented a cornerstone in the study 
of dynamical systems governed by maximally monotone operators in Hilbert spaces, as 
it addressed questions like the existence and uniqueness of solution trajectories and it 
related the latter to the theory of semi-groups of nonlinear contractions. Brezis has stud¬ 
ied in m the asymptotic behavior of the trajectories whenever the underlying operator 
is the convex subdifferential and Bruck proved in [T2] that a similar asymptotic conver¬ 
gence analysis can be made also in the general case involving an arbitrary maximally 
monotone operator. 

Dynamical systems governed by maximally monotone operators are recognized as valu¬ 
able tools for studying numerical algorithms for monotone inclusions and optimization 
problems obtained by time discretization of the continuous dynamics (cf. [H]). In this 
context we want to refer to the discrete forward-backward-forward algorithm (see [3 EO] ) 
which generates for an initial point xq E and a sequence of stepsizes (7n)n>o ^ (0,/3), 
via the iterative scheme 


(Vn > 0) 


Zn ■— J^riA{Xn 'Jn^Xn) 

Xn+1 ■— T BZn)i 


(3) 


two sequences (xn)n>o and {zn)n>o that converge to a solution of the monotone inclusion 
problem ([ 1 ]). 

Since they provide a deep understanding of the related discrete iterative schemes, 
dynamical systems assuming backward (implicit) evaluations of the governing opera¬ 
tors have enjoyed much attention in the last years. Abbas and Attouch addressed in 
[3 a forward-backward dynamical system associated to the solving of ([I]) for A the 
convex sub differential of a proper, convex and lower semicontinuous function and B a 
cocoercive operator, extending in this way the investigations made by Bolte in [S] on 
a gradient-projected dynamical system associated to the constrained minimization of a 
smooth convex function. The study in [T] has been further extended in [2j, this time for 
an arbitrary maximally monotone operator A and also by utilizing variable relaxation 
parameters, a fact which permitted the derivation of convergence rates for the fixed 
point residual of the generated trajectories. Recently, in the monotone inclusion 
problem ([T|) for B cocoercive has been approached in terms of a second order dynamical 
system of forward-backward type with variable relaxation parameters and anisotropic 
damping/variable damping parameters (see also OS])- For more literature addressing 
dynamical systems of implicit type we refer the reader to [3 El El [TO]. 

In the first part of the present manuscript we prove the existence of strong global 
solutions for the dynamical system ([5]) by making use the classical Cauchy-Lipschitz- 
Picard Theorem. This is followed by a convergence analysis for the generated trajectories. 
We show that that x{t) converges weakly, as t ^ -|-oo, to a solution of the monotone 
inclusion problem ([T]) under mild assumptions. We also show that, whenever A -|- R is 
strongly monotone, the trajectories converge strongly with exponential rate. 
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In the last part of the work we deal with the optimization problem 

minimize /(x) + h{x), 

where / : H —>■ M is a proper, convex and lower semicontinuous function and /i : "H —?■ M 
is a convex differentiable one with Lipschitz continuous gradient, by taking into consid¬ 
eration that its set of minimizers is nothing else than the solution set of the monotone 
inclusion problem 

find X S "H such that 0 G df{x) -|- V/i(x). 

We provide a rate of convergence for the objective function f + h along the ergodic 
trajectories generated by ([5]) (for A = df and B = 'Vh) to its minimum value. 

2 Preliminaries 

In this section we introduce some preliminary notions and recall some fundamental 
results that we will use throughout the paper. Let "H be a real Hilbert space. A set¬ 
valued operator M : Ti ^71 maps points of 7i to subsets of "H. We denote by 

Dom M := {x G ^ I Mx / 0} , 

Ran M := {?/ G I 3x G : y G Mx} , 

Graph M := {(x, y) G "H x "H | y G Mx} , 

Zer M := {x G I 0 G Mx} 

its domain, range, graph and zeros, respectively. The inverse operator of M is de¬ 
fined by M~^y = {xG'H\yGMx}, the multiplieation by a sealar A G M by (AM)x = 
{Ay I y G Mx}, and the sum with another operator B : T-L ^ Td via Minkowski sums by 
(M -|- N)x = {a -|- 6 I a G Mx and b G Ax}. 

A set-valued operator M : 7i is called monotone if 

(x — y,x* — y*) > 0 for all x, y G "H and x* G Mx, y* G My. 

It is called maximally monotone if it is monotone and there is no monotone operator 
whose graph contains Graph M properly. It is said to be p-strongly monotone with p > 0 

{x — y,u — v) > 7 ||x — y|p for all x, y G H and x* G Mx, y* G My. 

Notice that if M is maximally monotone and strongly monotone, then ZerM is a sin¬ 
gleton, thus nonempty (see [3 Gorollary 23.37]). 

The resolvent J-^m = (Id -|- yM)”^ of the maximally monotone operator yM for y > 0 
is a single-valued operator with Dom J.yM = hi and it is firmly nonexpansive, i.e., 

\\J-yMX - JjMvW'^ < {J-yMX - J-^My,x- y) for all x,y ehi. 

Here, Id : hi ^ hi denotes the identity operator on 71. The Yosida approximation 
of a maximally monotone operator M with parameter y > 0 is defined by M-^ := 
i(Id — J-yM)- It is i-Lipschitz continuous, and it holds 

X G Zer M J'yMX = x x G ZerM^x. 
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According to [3 Proposition 23.28] we have the relation 


\\Jxmx - Ji,Mx\\ < |A - /r| ||Max|| VA,^ > 0 Vx G U. (4) 

Let /3 > 0 be arbitrary. A single-valued operator M : "H —)■ "H is said to be /3-cocoercive, 
if {x — y, Mx — My) > /3||Mx — Mt/P for all (x, y) ^ Ti xTi, and ^-Lipschitz continuous, 
if II Mx —My 11 < ^||x —y|| for all (x,y) G "H xH. Obviously, every /3-cocoercive operator 
is monotone and ^-Lipschitz continuous, however, the opposite implication is not true. 

A function / : ^ M := M U {±oo} is said to be proper if it does not take the value 
—oo and dom/ := {x G "H | /(x) < -|-oo} / 0. It is called convex if 

/((I - A)x Ay) < (1 - A)/(x) A/(y) VA G [0,1] Vx, y eTi. 

The conjugate function ^ ^ M is dehned by 

f*{x*) = sup{(x*,x) - /(x) I X G "H} 

and it is convex and lower semicontinuous. If / is proper, convex and lower semicontin- 
uous, then f* is also proper. 

The convex subdifferential of / is defined by 

df{x) = {x* G ^ I Vy G "H : /(y) > /(x) -h (x*, y - x)} 

for /(x) G M and df{x) = 0, otherwise. It is a set-valued monotone operator df : Ti ^ 
%, which is maximally monotone if / is proper, convex and lower semicontinuous. 

We close this section by stating the solution concept we consider for the dynamical 
system ([ 2 ]). 

Definition 1. (see for instance [SIE]) ^ function x : [0, 6 ] —)■ (where 6 > 0) is said to 

be absolutely continuous if one of the following equivalent properties holds: 

(i) there exists an integrable function y : [ 0 , 6] ^ ^ such that 

x(f) = x(0)-|- [ y{s)ds VtG[0, 6 ]; 

Jo 

(ii) X is continuous and its distributional derivative is Lebesgue integrable on [0,6]; 
(hi) for every e > 0 , there exists y > 0 such that for any finite family of intervals 

Ik = (flfc) 6 fc) C [ 0 , 6 ] we have the implication 

4 n = 0 and \bk - 0^1 < y Y - x{ak)\\ < e. 

\ k J k 

Remark 1. (a) It follows from the above definition that an absolutely continuous func¬ 
tion on [ 0 , 6 ] is differentiable almost everywhere, its derivative coincides with its distribu¬ 
tional derivative almost everywhere and one can recover the function from its derivative 
X = y by the integration formula (i). 


4 


(b) If X : [0, 6 ] —)■ "H (where 6 > 0) is absolutely continuous and M : H ^ is a 
7 -Lipschitz continuous operator for 7 > 0, then the function z = M o x is absolutely 
continuous, too. This follows from the characterization of absolute continuity given 
in Definition [T](iii) . Moreover, z is almost everywhere differentiable and the inequality 
p(‘)ll ^ 7 ll^(')ll holds almost everywhere. 

Definition 2. We say that x : [0, +00) T-L is a strong global solution of ([2]) if the 
following properties are satisfied: 

(i) X : [ 0 , +00) —"H is locally absolutely continuous, that is, absolutely continuous on 
each interval [ 0 , 6 ] for 0 < 6 < +00; 

(ii) For almost every t S [0, +00) it holds x{t) +x{t) — z{t) — 'y{t)Bx{t) +'y{t)Bz{t) = 0, 
where z{t) = J^(t)A{x{t) - 'y{t)Bx{t)); 

(hi) x(0) = xq. 


3 Existence and uniqueness of trajectories 


In this section we investigate the existence and uniqueness of the trajectories generated 
by the dynamical system ([21). To this end we notice that the latter can be written as a 
non-autonomous differential equation 


x{t) = - -i{t)Bx{t)) - x{t) + -f{t)Bx{t) - -f{t) (^B o (x(t) - -f{t)Bx{t)) 


or, equivalently, as 


with / : (0, + 00 ) X "H —)■ M, 


i(i) = f{l{t),x{t)), 


/( 7 , x) := J'yAix — 'jBx) — X + 'yBx — 'y{B o J^a){x — 'jBx) 

= ((Id — 'yB) o Jyyi o (Id — yB) — (Id — yB))x. 

Lemma 1. Let x gB. be fixed. Then the funetion 7 i-A f{y, x) is eontinuous on (0, + 00 ). 
Moreover, if x & DomA, 

lim/( 7 ,x) = 0 . 

7I0 

Proof. The first statement is a direct consequence of ([Ij). Let x S DomA. By nonex- 
pansiveness of J.yA we have 

WJ'yA ° (Id — yB)x — J'yAxW < 7 ||Bx|| V 7 > 0. 

On the other hand, J.yAX -A ProJd(DomA) as 7 —)• 0 by [131 Theoreme 2.2], where 

Proj denotes the projection operator and one uses that cl (Dom A) is a convex and closed 
set. Hence J..fA ° (Id — yB)x ^ x as 7 —^ 0 and the assertion follows from the Lipschitz 
continuity of H. □ 


Lemma 2. For eaeh 7 E (0, fi) and x,y ^FL it holds 


11 /( 7 ,a^) - f{l,y)\\ <V6\\x- y\\ . 
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Proof. For the sake of brevity, let us write C ;= Id — -yB and J := By using the 
firm nonexpansiveness of the resolvent and the monotonicity and Lipschitz continuity of 
B we get 


11 /( 7 ,a:) - /(7,y)f 

= \\C o J o Cx - Cx - C o J o Cy + Cy\\^ 

= \\CoJoCx-CoJo Cyf + \\Cx - Cyf - 2 {C o J o Cx - C o J o Cy,Cx - Cy) 
= IIJ o Cx — Jo CyW"^ + 7 ^ ||i? o J o Cx — B o J o Cy\\‘^ 

— 27 (J o Cx — Jo Cy, B o J o Cx — B o J o Cy) 

+ \\Cx - Cyf - 2 {C o J o Cx - C o J o Cy,Cx - Cy) 

< ^1 + {Cx - Cy, J o Cx - J o Cy) 

— 27 (J o Cx — Jo Cy, B o J o Cx — B o J o Cy) 

+ \\Cx - Cyf -2{C o J oCx-C o J oCy,Cx-Cy) 

= ^1 + ^-2^ {Cx - Cy, J o Cx - J o Cy) 

— 27 (J o Cx — Jo Cy, B o J o Cx — B o J o Cy) 

+ \\Cx — Cyf + 27 (B o J o Cx — B o J o Cy, Cx — Cy) 

< \\Cx - Cyf + 2-i\\Bo J oCx- Bo J o Cy\\ \\Cx - Cy\\ 


< 


< 

< 



27 (x -y,Bx- By)^ 


□ 


Lemma 3. There exists a constant K > 0 such that 


11 /( 7 ,x)|| < K{1 + ||x||) 

for every 7 G (0, /3) and x G Ti. 

Proof. We fix an element x G Dom A in the domain of A, which is evidently nonempty. 
According to Lemma [T] the mapping 7 i-)- f{'y,x) can be continuously extended to 7 = 
0 , therefore the image of [ 0 , /3] under this extension is compact, hence bounded, say, 
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11 /( 7 , x)II < r for all 7 S (0,/3). Furthermore, by Lemma [5] and the triangle inequaity, 

11 /( 7 ,a:)|| < 11 /( 7 ,a;) - f{7,x)\\ + ||/(7,x)|| 

< \/6 ||x — x|| + r 

<-\/6 ||x|| + r + a/G ||x|| . □ 

Now we can state the existence and uniqueness statement. 

Theorem 1. Let 7 : [0,+oo) (0,/3) be measurable. Then, for each xq E H, there 

exists a unique function x : [0,+cx)) ^ Ti with x(0) = xq, which is locally absolutely 
continuous and x{t) = f{'y{t),x{t)) for almost every t E [0,+oo). 

Proof. The statement follows as a consequence of the Cauchy-Lipschitz-Picard Theorem 
(see mi Proposition 6.2.1]) applied for the mapping {t,x) f{'y{t),x) under the use of 

the previous two lemmas. For arbitrary x,y ^TL and every t E [0,+oo), by Lemma [21 
we have 

ll/(7(i),x) - fh{t),y)\\ < V6 \\x-y\\ . 

On the other hand, we recall that 7 /( 7 , x) is continuous on (0, + 00 ) for each x G'H,so 

t f{'y{t),x) is measurable, and it is bounded by Lemma[3l thus locally integrable. □ 


4 Convergence analysis 

In order to investigate the asymptotic properties of ([2D we need some inequalities which 
we derive in the next subsection. 


4.1 Some fundamental inequalities 


Lemma 4. If x and z are given by ([2D, then, for almost every t E [ 0 , +00), the following 
statements are true: 


(^) - ■®a;(t) E Azit); 


(b) 


id) 


+ Bz{t) — Bx{t) — — 7 :^ E (^ + B)z{t) 


a, 


Proof. The statement in 
in m follows by adding Bz{t) to 


is a reformulation of the first equation in ([2D, while the one 
and by using the second equation in ([2D. □ 


Lemma 5. Let x and z be given by ([2D and x E ZeT{A + B). Then, for almost every 
t E [ 0 ,+00), we have 

0 < ||x(t) — x||^ — ||x(t) — 2;(t)||^ — \\z{t) — x||^ + 2^{t) {Bx — Bx{t), z{t) — x) . 


Proof. As —Bx E Ax, it holds —'y{t)Bx E 'y{t)Ax for every t E [0,+cx)). By Lemma 
[ ^a)[ and the monotonicity of A, for almost every t E [0, + 00 ) it holds 

0 < 2 {x{t) — 7 (t)i?x(t) — z{t) + ^{t)Bx, z{t) — x) 

= \\x{t) — x||^ — ||x(t) — 2:(t)||^ — \\z{t) — x||^ + 2^{t) {Bx — Bx{t), z{t) — x) . □ 
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Lemma 6. Let x and z he given by ([ 2 ]), and let 7 : [ 0 , +00) —>■ ( 0 , /?) be locally absolutely 
continuous. Then z is locally absolutely continuous, and 





lit) L 


xit) 


4t)\\ 


for almost every t G [ 0 , +00). 

Proof. Let 5 > 0 be fixed. Since x,Bx and 7 are absolutely continuous on [ 0 , 6 ], the 
mapping t y{t) := x{t) — 'yit)Bx{t) is absolutely continuous on [ 0 , 6 ], We show that 
1 1-^ J-y{t)Aiyit)) is absolutely continuous on [0,6], as well. 

For every € [ 0 , 6 ], by using (UD and the nonexpansiveness of the resolvent, we get 


zit) - z(s)ll = 

J-ymivit)) - Jy(s)Aiyis)) 



= 

Jymiyit)) - j.y^t)Aiyis)) 

+ 

J-yDAivi^)) J'y{s)Aiyi^)) 


< II2/W -y(s)ll + \iit)-iis)\ 




m) 


Since 7 is continuous on [ 0 , 6], there exist 7min, 7max S ( 0 , / 3 ) such that 7niin < 7(‘) < 7max 
on [ 0 , 6]. Using that 7 1-^ jjA.y(7/(t))jj is nonincreasing and the Lipschitz continuity of the 
Yosida approximation, it yields for every s,t G [ 0 , 6 ] 


\zit) - z(s)ll < ll?/(f) - y{s)\\ + l7(t) - 7(s)l A^^t^{y{t)) 

< Il2/(i) - y('S)ll + |7(^) - 7('S)I P7min(2/W)ll 


< \\y{t) - y(s)ll + l7(t) - lis)\ 11A,„,„(0)11 + ^ 

\ /min 

From here the absolute continuity of z on [ 0 , 6] follows, by taking into consideration also 
that y is bounded. 

Applying Lemma [H I (a) | for s, / G [ 0 , 6], s 7^ t, we obtain by the monotonicity of B 

0 < i^zis) - z{t), -- Bxis) - —- + Bx{t)j , 

which is equivalent to 
z{s)-zit) 2 


s — t 


< 


z(s) — z(t) x(s) — x(t) 7(t) — 7(5) x(t) — z(t) Bx(t) — Bx(s) 

H-^-77^- hlis)- 


s — t s — t s — t 

so, by the Cauchy-Schwarz inequality. 


lit) 


s — t 


zis)-z{t) 


s — t 


< 


xis) - xit) ^ 7W -7(5) . xjt) - zjt) ^ _ Bxit) - Bxis) 


s — t 


s — t 


lit) 


s — t 
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By taking the limit s —?■ t, it follows that for almost every t € [0, +oo) 


< 




1 + 


ijt) 

7(i) 


{z{t) - x{t)) + j{t){Bx{t) - Bz{t)) - 'y{t)—Bx{t) 


( 5 ) 


According to Remark [T]J^b) we have ||^Rx(t)|| < ^ ||i(i)|| for almost every t € [0,+oo). 
Furthermore, by the monotonicity and the Lipschitz continuity of B, we have for almost 
every t E [0, +oo) 

II^WII^ = \\xit) - z{t)f + \\Bx{t) - Bz{t)f + 27 (t) {x{t) - z{t), Bz{t) - Bx{t)) 


< 1 + 


/32 


|x(t) - z{t)\Y 


( 6 ) 


as well as 


1 + 


i{t) 

i{t) 


{z(t) - x(t)) + 'y{t){Bx{t) - Bz(t)) 


/ n 1 , 7(^)^ , (7(i)) I II ,.mi2 

so, getting back to ([5]), we obtain 


z(t)\\ < 


1 + 


ijt) 

lit) 


iijt)) ^ lit) 


13^ 




1 + 


iiit)y 

/?2 


|x(t) - z{t)\\ 


□ 


When A + R is strongly monotone, we have the following strengthened version of the 
inequality in Lemma [SI 

Lemma 7. Let A + B be p-strongly monotone for p > 0, x and z be given by m and 
X E Zer {A + B). Then for almost every t E [0, +oo) we have 


0 < ||x(t) — x||^ — ||x(t) — z{t)\y — (1 + 2 p'y{t)) \\z(t) — x||^ 

+ 2'y{t) {Bz{t) — Bx{t), z{t) — x) . 

Proof. As 0 E 'y{t){A + B)x, and {A + B) is p-strongly monotone, by taking Lemma S] 
El into consideration, we have for almost every t E [0, -|-oo) 

2p7(t) ||- 2 ;(t) — x||^ < 2 (x(t) — z{t) + ^{t)Bz{t) — 'y{t)Bx{t), z{t) — x) 

and the assertion follows by rearranging the terms. □ 
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4.2 Asymptotic properties of the trajectories 

The following result, for the proof of which we refer to O Lemma 5.2], is the continuous 
counterpart of a classical result which states the convergence of quasi-Fejer monotone 
sequences. 

Lemma 8. If 1 < p < oo, 1 < r < oo, F : [0, +oo) [0, +oo) is locally absolutely 
continuous, F E ^^*([0, +oo)), G : [0, +oo) ^ M, G E L''([0, +oo)) and for almost every 
t E [0, +oo) 

f/{t) < G{t), 

then lim^^+oo F{t) = 0. 

The next result which we recall here is the continuous version of the Opial Lemma 
(see, for example, [21 Lemma 5.3], [H Lemma 1.10]). 

Lemma 9. Let S F H be a nonempty set and x : [0, Too) H a given map. Assume 
that 

(i) for every x E 5, limj_,._|_oo ||ic(t) — a^H exists; 

(a) every weak sequential cluster point of the map x belongs to S. 

Then there exists Xoo £ S such that x{t) converges weakly to Xoo as t ^ +oo. 

The following proposition will play an essential role when establishing the asymptotic 
properties of the trajectories generated by m- 

Lemma 10. Let x E Zej:{A + B). Then t ||ic(t) ~ ^|| is monotonically decreasing 
and (l — < +oo. 

Proof. For almost every t E [0,+oo), by using Lemma El the monotonicity and the 
Lipschitz continuity of H, we have 

^ ||®(t) — x\f = 2 {x{t) — X, x{t)) 

= 2 {x{t) — x, z{t) — x{t) + 'y{t)Bx{t) — 'y{t)Bz{t)) 

= \\z{t) — x||^ — \\x{t) — 2;(t)||^ — \\x{t) — x\\‘^ 

+ 2j{t) {x{t) — X, Bx{t) — Bz{t)) 

< — 2 \\x{t) — ^(t)ll^ + 2^{t) {Bx — Bx{t), z{t) — x) 

+ 2'y{t) {x{t) — X, Bx{t) — Bz{t)) 

< — 2 \\x{t) — ^(t)ll^ + 2j{t) {Bz{t) — Bx{t), z{t) — x) 

+ 2'y{t) {x{t) — X, Bx{t) — Bz{t)) 

= — 2 \\x{t) — ^(t)ll^ + 27 (f) {Bz{t) — Bx{t), z{t) — x{t)) 

< 2 (^^-l) \\x{t)-z{t)f <0, 
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which shows the decreasing property. Integrating from 0 to T, for T > 0 , yields 



dt < 


|x( 0 ) — x||^ — \\x(T) — x|' 


< 


|x(0) — x\\ 


which is independent of T. 


□ 


Theorem 2. Let Zej:{A + B) ^ 0 and let 7 be locally absolutely continuous such that, 
for some 5,e > 0 , we have 6 < 'y{t) < jd — e for all t E [ 0 , +00) and 7 E L°°([ 0 , +00)). 
Then the trajectories x{t) and z{t) generated by ([ 2 ]) converge weakly to an element in 
Zer {A + B) as t ^ +00. 

Proof. According to Lemma fTHl we have that t \\x{t) — z{t)\\‘^, mapping from [ 0 , +00) 
to [ 0 ,+oo), belongs to L^[ 0 ,+00). Furthermore, by the Cauchy-Schwarz inequality, the 
triangle inequality, ([ 2 ]) and Lemma El we have that for almost every t E [ 0 ,+oo) 



z{t)\\ = 2{x{t) - z(t),x(t) - z{t)) 

< 2(||x(t)|| + ||i(t)||) ||®(t) - 2(t)|| 


< i 1 + 




f)f 


(7W)' 

/12 


|x(t) 


< 




1 + 


L°°ao,+oo)) j \ ||x(t) - 


zit)f 


By LemmaElwe have limj^+oo \\x{t) — = 0, which implies, via ([S]), that x{t) 0 

as t ^ +00. Let w G TL he a weak sequential cluster point of x{t) as t ^ +00 and 
{tn)n>o ^ sequence in [0,+00) with tn +00 and x{tn) ^ w as n ^ +00. Since 
lim^^+oo ix{t) — z{t)) = 0, we also have z{tn) w as n ^ 00 . Furthermore, — ^|***| —>■ 0 
as n —)• +00, since 7(tn) > h for all n > 0. 

By Lemma lll |(b)| and the fact that the graph of the maximally monotone operator 
A + B is sequentially weak-strong closed (see [71 Corollary 24.4, Proposition 20.33]), 
we have {w,0) E Graph (A-|-B), thus w E Zer(A-l-B). By Lemma fTUl ||x(t) — x|| 
converges as t ^ -|-oo. According to the Opial Lemma, x{t) (and, consequently, z{t)) 
converges weakly to an element of Zer {A + B) as t ^ +00. □ 


For the important special case of strongly monotone inclusions, we are able to show 
strong convergence of the trajectories to solutions without any continuity assumptions 
on the function 7. 


Theorem 3. Let A + B be p-strongly monotone for p > 0. and let x E Zer (A + B). 
Then we have for every t E [ 0 , +00) the estimate 


\x{t) — x\\ < 


|x(0) — x\ 


exp 


(/< 


t 2fyy{s){P-j{s)) 
0 i3/yy(s)+l3--y{s) 


ds 


11 


















In particular, if 


r+oo 


2p7(s)(/3-7(s)) 


ds = +00, 


Jo I3pjis) + I3- 7(s) 
then x{t) converges in norm to the unique element of Zer {A + B) as t ^ +oo. 

Proof. For almost every t E [ 0 ,+oo), by using Lemma [3 the monotonicity and the 
Lipschitz continuity of i?, we have 


dt 


|x(t) — x\f =2 {x{t) — X, x{t)) 


=2 {x{t) — x, z{t) — x{t)) + 2j{t) {x{t) — X, Bx{t) — Bz{t)) 
= ||z(t) — x||^ — ||x(t) — 2;(t)||^ — ||x(t) — x||^ 

+ 2'y{t) (x(t) — X, Bx{t) — Bz{t)) 

< — 2 ||x(t) — z{t)\\'^ + 2^{t) {x{t) — z{t), Bx{t) — Bz{t)) 
-2p7(t) \\z{t) - xf 

x{t) - z{t)\f - 2pj{t) ||2:(t) - xf . 




For a : [ 0 , +oo) —>■ ( 0 , +oo), 


we have 


, . B — 'y(t) 


Ikw - xf > (1 - a{t)) ||i,'(() - 3(«)||^ ^ “ fy) 

in other words, 

-2p7(t) \\z{t) - xf < 2(^1 - ||x(t) - 

for every t E [ 0 ,+00). Consequently, 


— X 


2 ‘^Pl{t){P - lij)) II -||2 


/3p7(t) + /3 - 7(t) 


|x(t) — x\ 


A Ib 7 ) _ a ;||2 < _ 2 p 7 (t)(/ 3 - 7 (t)) _ 2 


for amost every t E [ 0 , +00). By Gronwall’s inequality, for every t E [ 0 , +00) we have 


|x(t) — xf < 


|x(0) — x|' 


exp 


(/< 


t 2fyy(s)(p-j{s)) , 
0 Pp'y{s)+p-'y{s) ^ 


□ 


Corollary 1. Let A -\- B be p-strongly monotone for p > 0 and 7 let he such that for 
5,e > d we have 5 < 7(t) < jB — e for all t E [ 0 , +00) Then the trajectory x(t) converges 
to the unique element of Zer {A + B) with an exponential rate as t ^ +00. 
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Proof. Let x be the unique element of Zer {A + B). According to Theorem [3] it holds for 
every t E [0, +oo) 


\x{t) — x\\ < 


|x(0) — x|| 


exp 

= ||x(0) — X 

which leads to the desired conclusion. 


/ rt 2p'Y(s)(/3-'y(s)) , ' 
\^J0 /3pj(s)+/3-j(s) 

^ 2pSet 

/3p(P-e)+f3-S ^ 


< 


|x(0) — x|| 


exp 


(/< 


t 2p5e 1 
0 /3p(/3-£)+/3-fi as 


□ 


Remark 2. Corollary [T] can be seen as the continuous-time counterpart of [121 Theorem 
3.4], 


4.3 Ergodic objective rate for convex minimization problems 

Consider the convex minimization problem 


minimize f{x) + h{x), 


where f : T-L ^ M is a proper, convex and lower semicontinuous function and h : PL ^ 
M a convex and Frechet differentiable one with a ^-Lipschitz continuous gradient for 
/3 > 0. Since argmin(/ + h) = Zer((9/ -|- V/i), one can approach this set by means of 
the trajectories of the dynamical system ([2|) written for A = df and B = 'Vh. We 
notice that, for ?? > 0, the resolvent of rjdf is given by = Prox^j (see [7]), where 
Prox^j : PL ^ PL, 

Prox^y(x) = argmin 
yen 

denotes the proximal point operator of rjf. Thus, the dynamical system ([2D becomes 




( z{t) = Prox^(i)y {x{t) - -f{t)Vh{x{t))), 

< 0 = x{t) + x{t) - z{t) - j{t)Vh{x{t)) + ^{t)Vh{z{t)) (7) 

[ x(0) = xo- 


In the following, we are concerned with the asymptotic behavior of the ergodic trajectory 
C(t) := ^ ^ 7('S)^;(s) ds, where T{t) := 7(5) ds, 

of 2; with weight 7 as t ^ -|-oo. 


Theorem 4. Let f : PL ^ M be proper, convex and lower semicontinuous, /i : "H —s- M 
be convex and dand Frechet differentiable one with a ^-Lipschitz continuous gradient for 
jd > 0, x and z be given by (ED and let 7 : [0, -|-oo) (0, /?) be Lebesgue measurable. 

Then 

(/+ft){c(t)) <(/+/!) w + (8) 

for every x & PL and every t > 0 such that C(t) E dom/. 
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Proof. Let x € H and t > 0 be such that ({t) € dom / fixed. We have, by Lemma 0] (b) 

x(s) 


7(s) 


€ {df + Vh){z{s)) = d{f + h){z{s)) 


and further, by the subdifferential inequality, we obtain 


{f + h){x) > if + h){z{s)) + - zis)'^ 


(9) 


for almost every s E [0, +oo). By the Lipschitz continuity of B and the Cauchy-Schwarz 
inequality it follows that for almost every s E [0, +oo) 

(x(s), X — ^(s)) = (x(s) — 2;(s), x(s)) + (x — x(s), x(s)) 

= (x(s) — 2;(s), 2;(s) — x(s) + 'y{s)Bx{s) — 'y{s)Bz{s)) + (x — x(s), x(s)) 

< — ||x(s) — ^;(s)||^ + -4^ l|a^('S) — -2(5)11^ + (x — x(s),x(s)) 


(3 


<{x — x(s), x(s)) 


lA 

2 ds 


|x(s) — x| 


By Jensen’s inequality in integral form, ([9]) and the previous estimate we have 


{f+h)m) = {f+h) 


m 


7(s)2;(s) ds 


< 


m 


7(s)(/ + h){z{.s))ds 


< 


f(t) Jo ^ ^ ® - ^(«))) ds 

"x(0) — x||^ — ||x(t) — x||^ 


= U + h){x) + 


2 T{t) 


□ 


11 (i'\ 11 ^ 

from which the assertion follows by neglecting the nonpositive term ~ A(t)^ • 

Remark 3. If PL is finite dimensional or dom/ is closed, then one can use Jensen’s 
inequality in integral form in a less restrictive way (see for instance [E]). Under these 
premises inequality ([5]) in Theorem 0] is fulfilled for every x & PL and every t > 0. 

Remark 4. The statement of Theorem 0] holds in a similar form for the discrete version 
given by the forward-backward-forward iterative algorithm, too. Let xq E "H be arbitrary, 
(7n)n>o U (0,/J), and (xn)„>o and {zn)n>o be the sequences generated by 


(Vn > 0) 


Zn ;= PrOX^„/ {Xn “ 7nV/l(Xn)) 
Xn+l ■ — Zji 7n(Vh(Xfi) V/l(Z}^)). 
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Let X gT-L and n > 0 be fixed. For any /c > 0 we have 

Xk- Zk- 7fcV/i(xfe) G Jkdfizk), 
so 

- Vh{xk) + Vh{zk) G d{f + h){zk). 

Ik 

The subgradient inequality yields for any k > 0 

if + h){zk) < if + h){x) - ~ '^Hxk) +Vh{zk),x - Zk'^ 

= if + h)ix) - — {xk- Xk+i,x - Zk) ■ 

Ik 

On the other hand, for any /c > 0 it holds 

(Xfc+l -Xk,X- Zk) = ^(llxfc+i - Zk\f + \\Xk - x\\^ - lixfc+i - x||^ - ||Xfc - 

2 _ '>'fe 

< 2 (ll^^ “ “ ^11^)-^ 

< - x\\^ - ||Xfc+l - x||^), 

thus 

if + h)izk) < (/ + h)ix) + “ \\xk+i - )• 

Setting 

n -y n 

Tn := XI and Cn := X ^^Zk, 

k=0 ^ ^ k=0 

we obtain, by Jensen’s inequality in discrete form, that 

1 

if + h)iCn) < Y^J2^kif + h)izk) 

n=0 

Y n 

< (/ + /i)(x) + — X {\\xk - a^f - ||a:fc+i - a;f) 

^k=o 

= if + h)ix) + ^(iko - a;f - ||xn+i - xf) 

n 
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